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Abstract 

Petri nets augmented with timing specifications gained a wide acceptance in the area of perfor- 
mance and reliability evaluation of complex systems exhibiting concurrency, synchronization, and 
conflicts. The state space of time-extended Petri nets is mapped > >oto its basic underlying stochastic 
process, which can be shown to be Markovian under the assumption of exponentially distributed 
firing times. The integration of exponentially and non-exponentiallv distributed timing is still one 
of th:? major problems for the analysis and was first attacked for continuous time Petri nets at the 
cost of structural or analytical restrictions. We propose a discrete deterministic and stochastic Petri 
net (DDSPN) formalism with no imposed structural or analytical restrictions where transitions can 
fire either in zero time or according to arbitrary firing times that can be represented as the time 
to absorption in a finit e absorbing discrete time Markov choin (DTMC). Exponentially distributed 
firing times are then approximated arbitrarily well by geometric distributions. Deterministic fir- 
ing times are a special case of the geometric distribution. The underlying stochastic process of a 
DDSPN is then also a DTMC, from which the transient, and stationary solution can be obtained by 
standard techniques. A comprehensive algorithm and some state space reduction techniques for the 
analysis of DDSPNs are presented comprising the automatic detection of conflicts and confusions, 
which removes a major obstacle for t;he analysis of discrete time models. 
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•This research was supported in part by t he National Aeronautics and Space Administrat ion under NASA Contract 
No. NAS 1-19490 while the second author was in residence at the Institute for Computer Applications in Science and 
Engineering (ICASE). NASA Langley Research Center. Hampton, VA 23681-0001. 
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1 Introduction 


Petri nets (PN) (13] proved to be a powerful graphical and mathematical modeling tool that allows 
to describe and analyze complex systems exhibiting concurrency, synchronization, and conflicts. 
The ability to model timed and probabilistic behavior is essential in the field of performance and 
reliability evaluation. This need leads to various different extensions of the PN formalism, where 
the class of stochastic Petri nets (SPNs) gained the widest acceptance. In SPNs, firing time delays 
are specified by probability distributions associated to transitions. SPNs are often classified as 
continuous or discrete time, depending on the type of fixing time distributions and on the underlying 
stochastic process. 

Deterministic and stochastic Petri nets (DSPNs) [3] represent the most important continuous 
time approach where transitions can fire either in zero time or after a constant (deterministic) 
or exponentially distributed time delay. The initial definition of DSPNs imposed the structural 
restriction that concurrent deterministic activities cannot be present. This problem was theoretically 
solved in [10]. However, the solution is not feasible in practice because it leads to a state space 
explosion when a larger number of concurrent deterministic activities is to be considered. 

Discrete time stockastic Petri nets [12] belong instead to the discrete approach, where transition 
firing times are specified by geometric distributions which approximate the exponential distribution 
arbitrarily well in discrete time. Other approaches having an underlying discrete time stochastic 
process have been presented in [15] (Timed Petri nets) and in [11) (Generalized Timed Petri nets), 
but they does not achieve the modeling power of DSPNs. 

The mixture of deterministic and stochastic firing times still imposes severe problems on the 
quantitative analysis of a time-extended PN, since the state space needs to be generated and mapped 
onto the basic underlying stochastic process. Our work attacks this problem by adopting a pure 
discrete-time approach. However, conflicts and confusions among transition firings are more likely 
to occur in discrete than in continuous time, since transitions are allowed to fire only at certain 
discrete instants of time. Thus, simultaneous firing attempts of all transitions, including the timed 
transitions, can take place. The detection of the sets of transitions involved in conflicts and con- 
fusions is a precondition for the: correct specification of probabilistic firing weights resolving these 
situations. This is an important and oftenly neglected issue especially for discrete time models. 

In [14], Discrete time Deterministic and Stochastic Petri nets (dtDSPNs) were introduced where 
transitions fire either in zero time or after a constant or geometrically distributed time delay without 
any structural restriction. The deterministic time delay is then modeled as a special case of the 
geometric distribution. In dtDSPNs, the problem of conflicts and confusions is relaxed to a certain 
degree by an unconventional approach. The sequentialization of simultaneously fireable timed tran- 
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sitions is not enforced, which leads to the elimination of confusion situations for timed transitions. 
The drawback of this approach is that a dtDSPN model can generate states which aTe not covered 
by the classical Petri net theory. 

A more general approach was proposed in [5] with Discrete Time Markovian SPNs (DTMSPNs), 
where firing time distributions are specified by arbitrary finite absorbing DTMCs. It has been proven 
in [5] that the underlying stochastic process of a DTMSPN is a DTMC, provided that the modeler 
detects and resolves all conflicts and confusions manually, possibly a very difficult task. This 
drawback lead in [8] to the development of a new method for the automatic detection of conflicts 
and confusions applicable to all types of stochastic Petri nets. This approach is independent of 
structural PN properties and is solely based on the state space generation of a given model, so 
that only actually occurring conflicts and confusions are detected. This is is not the case for 
the structural tests employed in continuous time approaches, which are based or necessary, not 
sufficient, conditions. Thus, structural tests can lead to an overspecification of a given model 
resulting in a more difficult correct interpretation of obtained results measures. 

ine work presented in this paper combines the results of [14], [5], and [8], while removing the 
mentioned drawbacks of [14] and [5], We define discrete deterministic and stochastic Petri nets 
(DDSPNs). In DDSPNs, transitions can fire either in .zero time or after a time delay specified by 
arbitrary finite absorbing DTMCs without any structural restriction. Firing time distributions of 
a DDSPN include the geometric and the deterministic distribution as a special case. Any other 
discrete distribution that can lie expressed by a finite absorbing DTMC can be freely defined, such 
as the discrete uniform distribution. We adapt the general approach for the automatic detection 
of conflicts and onfusions from [8] and integrate it into the solution method for the analysis of 
DDSPNs. Together with the solution method, a new algorithm for the complex and non-trivial state- 
space generation is presented, mapping a DDSPN onto a DTMC, from which again the transient 
and stationary solution can be obtained by standard techniques. Finally, some state space reduction 
techniques for DDSPNs are proposed to relax the inherent problem of state space explosion. 

Section 2 defines untimed PNs. Section 3 introduces the discrete firing time distributions of 
DDSPN transitions. Sections 4 and 5 p^-scnt the complete DDSPN formalism itself and the cor- 
responding state space reduction methods. Numerical results arc shown in Section 6, followed by 
concluding remarks in Section 7. 
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2 The PN Formalism 


We recall the (extended) PN formalism used in [8]. See also [4] for more details on PNs with 
marking-dependent arc multiplicities. A PN is a tuple (p,T,D~,D + t D°,>-,g,fj)- 0 where: 

• P is a finite set of places , which can contain tokens. A marking p € 1N^ defines the number 
of tokens in each place p € P, indicated by p p (when relevant, a marking should be considered 
a column vector). /}", D + , D c , and g are “marking-dependent", that is, they are specified as 
functions of the marking. 

• T is a finite set of transitions. P C\T = 0. 

• Vp 6 P,'4t € T, Vp € 1N |P| , D Pii (p) € IN, D+ t (p) € IN. and Z?° it (/u) 6 IN are the multiplicities 
of the input arc from p to t, the output arc from t to p, and the inhibitor arc from p to t, when 
the marking is p, respectively. 

• >- C T x T is an acyclic (pre-selection) priority relation. 

• Vt f. 7\Vp€ € {0, 1} is the guard for t in marking p. 

• 6 1N*^ is the initial marking. 

Places and transitions are drawn as circles and rectangles, respectively. The number of tokens in 
a place is written inside the place itself (default is zero). Input and output arcs have an arrowhead 
on their destination, inhibitor arcs have a small circle. The multiplicity is written on the arc (default 
is the constant 1); a missing arc indicates that the multiplicity is the constant 0. The default value 
for guards is the constant 1. 

Let £(p) be the set of transitions enabled in marking p. A transition t <= T is enabled in marking 
p if, and only if, its guard evaluates to 1, its input and inhibitor arc conditions are satisfied, and 
no other transition with pre-selection priority over t is enabled (this is well defined because >- is 
acyclic): 

- 1) a (Vp € P, D~i(p) <p p A (D* f (p) > p ? V D\j(p) m o)) A (Vu € C(p),u / t ) . 

A transition t € £{p) can fire, causing a change to marking M(t.p), obtained from p by 
subtracting the input bag D^(p) and adding the output bag D+ t (p) to it: 

M(t,p) = p - D~ t (p) + D+ t (p) - p + £. (< (p), 
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where D = D + — D~ is the incidence matrix. M can be extended to its reflexive and transitive 
closure by considering the marking reached from fi after firing a sequence of transitions. The 
reachability set is then given by 

S = {v: 3<r€T*A M = M(<r,M [0] )}, 

where T m indicates the set of tvansition sequences. The reachability graph is (5, *4), where A contains 
an arc iff p € S, t € T, and p! — M(t,p). 

3 Discrete Time Phase Distributions 

Firing times of transitions in DDSPNs are modeled by discrete time phase distributions (DTPs). 

Definition 3.1 A DTP is represented by a finite absorbing discrete time Markov chain 
(DTMC) 6 IN} where 

• 6 > 0 is the underlying constant time-step. 

• Xu 6 / « {n,n — the finite state space of the DTMC. Each state corre- 

sponds to a possible distribution of the remaining firing time (RFT) for a transition. 

• VA € /,Pr{X 0 « A} is the initial probability distribution, such that £* 6 /Pr{Xo = 

A} = 1. 

States 1 \ {0} are transient. State 0 is absorbing and represents the case that a phase 
reached zero and that the corresponding transition is allowed to fire. □ 

Two additional symbolic DTP states, whose sojourn times are zero, b and •, are introduced. 
The symbolic state b (for begin) represents the initial probability distribution of a DTP. Since DTPs 
will be used for modeling RFTs of transitions, a second symbolic state • is needed to represent 
unambiguously the case when a transition is disabled and no definite phase is specified. 

Special cases of a DTP are for instance the geometric, constant, and the uniform distribution. 
In the following we will show how these discrete distributions can be represented by DTPs. From 
now on, the states of I will be referred to as phases , to make a clear distinction between DTP states 
and the overall 9tate space of a DDSPN. 

Geometric Distribution 

The geometric distribution, Geom(a,ui) with probability or <z (0,1), approximates the exponential 
distribution in discrete time arbitrarily well as its unit-step u > 0 decreases. The probability mass 
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function (pmf), cumulative probability distribution function (CDF'! and expectation of a random 
variable X ~ Geom(o,u)) are then given by 


• pmf: 


Px(w) = 


a(l - a) 1-1 if i € IN + , where IK + = {1,2, 3, 
0 otherwise. 


• CDF: 


Fx(z) = 


I 


1_(1 _ a )l5j 

0 


if x > 0, 
otherwise. 


• mean: - (average delay) 


Wf(iw 1 M*) 




pm i PDF 


Figure 1: X ~ Geom(0.5,«). 

Fig. 1 shows the pmf and CDF of X ~ Geora(0.5,u>). The DTP representation of Geora(<v,w) 
depends on its unit-step u, defined as an arbitrary non-negative integer multiple, u m cS,c € 1N + , of 
the constant basic underlying time-step 6 > 0 of all DTPs. For example, two geometric distributions, 
Geom(l/5,£) and Geom(4/5,4<f), have different DTPs but the same mean value of 56. Fig. 2 shows 
the DTP representations of X ~ Geom(a, 6) and X — Geom(a,4<5). The states of a DTP (or 
phases) are represented b y nodes a,nd the p robabilistic state transitions by labeled arcs. 

Cb>l^a-<oC 

C«om(a,.l<S) Ceom(oi, o) 

Figure 2: DTP representations of geometric distributions. 


Constant Distribution 

The constant distribution, Const(w) with w > 0, can be seen as a special case of the geometric 
distribution, where a - l, so Const(w) = Geom(l,u>). The p 'f and CDF (Fig. 3) of a random 
variable X Const(w) are then given by 


• pmf: 


• CDF: 


Px{m) 


1 if * » 1, 

0 otherwise. 



if x < u, 
otherwise. 


px(tu) 

i4 


0 w 2 l; 




pmf 


4 


0 u; 2u> 


l'DV 


Figure 3: X ~ Const (w). 

Immediate transitions (firing in zero time) can be modeled by a special case of the constant 
distribution where X ~ Const(O). Fig. 4 shows the DTP representations of X ~ Const(O) and 
X ~ Const(4d). 


t;b>. t*(§0 

Cwuit(4<) Coojt(O) 

Figure 4: DTP representations of constant distributions. 


Discrete Uniform Distribution 


Like the geometric distribution, the discrete uniform distribution, Unif(e,i>,u;) where <i,6 € IN, a ' 
fc, and w is a multiple of $. The pmf, CDF, and expectation of a random variable X ~ Unif(a, b t u) 
are then given by 


• pmf: 



(6 — a *f 1)“* 
0 


if? € {a, a + 1, 
otherwise. 


• CDF: 


Fx(x) = 


0 

<l*j “« + l)(6-« + l)-» 
1 


if x < aw, 
if aw < x < 6u>, 
if x > bu. 


• mean: (average delay) 

Fig. 5 shows for example the pmf and CDF of X ~ Unif(2,5,w) and Fig. 6 the DTP represen- 
tations of different uniform distribution examples. 
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px(lttf) 



paii 


««w 



Figure 5: X — Unif(2,5,w). 


Ufljf(0,2,#} : 
<&“ 2/3 

Uaif (1,3,3) : 

(S>-i 


Unif (1,3,23) : 

(£>-• i-»<D- 

(>'aif(2, 5,3) : 


Figure 6: DTP representations of uniform distributions. 

The DDSPN Formalism 






Basic definitions of the DDSPN formalism and the specification of race policies are explained in 
Sections 4.1 and 4.2, respectively. Sections 4.3 and 4.4 examine the DDSPN state space and 
introduce the concept of well-defined DDSPNs. which I? needed for the correct generation of the 
underlying stochastic process of a DDSPN model. Finally, Section 4.5 proposes an algorithm for 
the reduced reachability graph generation of a well-defined DDSPN from which the underlying 
stochastic process can be derived and numerically analyzed. 


4.1 B?sic: Definitions 

Informally, a DDSPN is obtained by associating a discrete time random delay, a DTP, to each PN 
transition. A state s of a DDSPN consists of two discrete components, the marking n and the 
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vector 4> containing the phase for each transition: 

$ = €lN ,p ! xK |T| , 

Each entry 4>t of <f> represents the current phase of the DTP associated to transition t. 
Definition 4.1 Formally, a DDSPN is a tuple 

(p, pH, *w, $, <?, F, <f> [ 0 K *,c,w) 

where: 

• (P,T, D",D + ,D 6 , defines an extended PN as introduced in Section 2. 

• Vt € T,$t C N is the finite set of phases of the DTP associated to transition i. 

• Vp € S , Vt € T,Vi,j € is the probability that the phase of transi- 

tion t changes from i to j in marking n at the end of one time-step 6, Hence, 
Ejeo, <?((•> i,j) == 1. G t specifies the one-step transition probability matrix of the 
DTP of an enabled transition t in isolation. The phase of a disabled transition does 
not change in isolation: G,(^, »,*) -I if < **(/<). 

All combinations of possible new phases for all enabled transitions must be con- 
sidered when 4> is changed at the end of a step of length S. This leads to the 
construction of the set Q{n,4>), such that V<£' € Q{n,4>), <j>' is a possible combina- 
tion of phases for all transitions: 

- Xte T$f where 4f = [J {<#}. 

• € 5,Vt € S(ix)^u € T, Vi, j 6 $ u , F t , u (^, i j ) is the probability that the phase 
of transition u changes from ; when transition t firesrin marking /i. 

F is used for the specification of race policies (see Section 4.2) for transitions. 
Again, all combinations of possible new phases for all transitions need to be con- 
sidered when 4> is changed by the firing of i in /j. leading to the construction of the 
ser. //, <£), such that € P"(t, /i. d>), $ is a possible combination of phases for 
all transitions: 


whesre = [J {<#,}. 

• V/ € T,<^ e $>< is the initial phase of transition t at time 0. 

• >~C T x T is an acyclic post-selection priority relation. 
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• C C 2 T is a partition of T into locally defined weight classes: VC*, C v € C,C X jL 
Cy^C x fl C v — 0 and Uc,ec C* — Z\ Let Ct be the local weight class containing 
transition t € T. By setting C x = T , we can model a global weight definition as in 

w- 

• V/r € £,Vt € £(p), VS C C< fl £(p),utys(/i) € IR + is the firing weigh* for i in 
marking p when 5 is the set of candidates to fire in the same weight class as i. See 
the following description for the definition of a candidate. 


□ 

In a DDSPN, a transition may only fire in a state where it is a candidate. For this reason, the 
enabling rule of Section 2 needs to be extended by the following definition. 

Definition 1.2 A transition t € T is a candidate (to fire) in state s = (p t 4>) iff it is 
enabled, its phase is zero, and no other candidate has post-selection priority over it (this 
is well defined because »- is acyclic): 

1 . 1 € £{p) a 

2. & = 0 A 

3. Vv 6 2\u 'if- 1 V u is not a candidate in $. 

□ 


Moreover, the firing rule of Section 2 is extended from markings to states for DDSPNs. Let C(s) 
be the set of candidates in state s = (p, <£). Then, the probability that transition t £ C (a) is chosen 
to fire, given that one of the transitions in its weight class C t fires, is 


w<|C(»)nc,(^) = 


tt*Hc(>)nc.OO 

£ UiW.Jnc.M 

u€C(*)nC, 


Note, that in DDSPNs firing probabilities are only defined among transitions belonging to the same 
weight class. 


4.2 Race Policies 

A candidate transition t € C(s) may fire in a state s = (p,4>) leading to the new marking p' - 
M{t,p). Dynamic race policies (1) can be then expressed for a transition u € T, where u ^ t, 
according to F».,( p , This means that, depending on which transition t fired, one of the following 
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three race policies is applied to u which may cause its phase <j> u € $>„ to (re)sample a random deviate 
4>' u € from the distribution F itU (n, •, •): 


R-R, race with resampling: 

The phase of tt is always resampled 

f <7«(/x,6,&) ifu€S(S), 

Wv € Ft ,«(/*> $,) = | 1 if « £ £(p') A = •, 

[ 0 otherwise. 

The resampling policy is always used when u = i or when <f> u ~ •. In all other cases, it can still be 
used, or one of the following two policies can be used instead. 

R-A, race with age memory : 

The phase of u is not changed by the firing of t 


[ 0 otherwise. 


R-E, race with enabling memory: 

The phase of u is only resampled if u becomes disabled by the firing of t 

1 if u € Sip 1 ) A 4>l = <f> u , 

- i 1 if U g S(ft') A 4>u - •, 

0 otherwise. . 

The approach just described allows different race policies to be applied to a transition u € T 
depending on which transition t 6 T fires. Thus, it extends the modeling power by generalizing the 
definition of [1], where a transition may have only a single race policy for all transition filings. 


4.3 The DDSPN State Space 

The underlying stochastic process of a DDSPN is a DTMC € IN} with state space 

S C Ds' |P| x N |T| . The time-step of the DTMC is given by S, such that g S is a DDSPN 

state at step k at time kS. 

We adopt the terminology of [2] and Call a state s tangible if its sojourn time is greater than 
zero, C(s) ss 0, vanishing otherwise. Consequently, S consists only of tangible states. 

Consider a tangible state s 1 * 1 « at titne. step k, At the next time step k + 1. the; new 

tangible state sP +l l is obtained by first advancing the phases of all enabled transitions in then 
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by subsequently traversing vanishing states created by the possible firing of a sequence of one or 
more candidate transitions. A more detailed definition of a state at tine step fe -f 1 is then given 
by the following: 

• Let the new tangible state reached after any firings occurring at time step k + 1 be 

• Let «t*+i]o = denote the first state reached from where 

- no firing occurred: j# + 1 l a = /J® and 

- the time is advanced: 0 ^ + 1 l° € G(jA k \4$)' 

• Let = (^[ fc +»l* > ^[ fe + 1 l‘) # i e {1,2, ...,n} denote the i-th state entered after the firing of a 
transition V € C(s^ +l ^" 1 ), such that 

— V fires: = Al(t*, and 

- the race policies are applied: 

After n possible firings in n vanishing states st* + 1 l’, i = 0, n— 1 , we define the first reachable 
tangible state to be s!* +1 l sf st*+tl n . Kote that — ^ik+tl if C($l* + 1 l°) « 0 , that is, if no 

firing occurs. 

The previous definition describes a single state sequence s* — € {0, 1, of states 

leading from to s^ fe+ 1 l. For better readability, let ~ s and = s. Then, the set S»,< of all 
state sequences from a = {fi. 4>) to sill possible s = (£,<£) is given by 

5.., = {s* = (i° = (A 0 , 4>% S 1 - (£\ H • • • , 5 n = (M n , 4> n )) | 

V<£°€ G{fi,<t>), 5° =s (fj, 4>°), 

Vi € {1,2, ...,n}, W 6 C(J’- 1 ), V# 6 S* « #)}. 

The probability of a single state sequence s" € S,,j is then given by 

n 

Pr{s a \s m € 5,,i A $ € $*} = g * (/* * ?*) where 

9~ riser Gtfafait) 

is the probability for a single combination of pha&i jP € G{pi4>) and where for a transition t l 6 
C(3 ,_1 ), such that jp ss 

is the firing probability and 

r = UutTFvAr\fc\p 

is the; probability for a single combination of ft 6 F(t\ Fig. 7 shows a possible sequence 

of states leading from s to 3 and the involved probabilities. 
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V*€<1, 


...»} : : - s 


n 

firings in 
zero-time 


Figure 7: A sequence of states s" leading from $ = to 5 = 


4.4 Well-defined DDSPNs 

The underlying stochastic process of a DDSPNJntroduced in Section 4.3 takes only the tangible 
state space and the sojourn time in a particular state into consideration. However, for the analysis 
of a DDSPN, a more detailed process is needed, extending the de mition of Section 4.3, to take into 
account the firing of transition sequences leading from one tangible state to another. 

Definition 4.3 The underlying stochastic process for a DDSPN, or basic process, is 
€ IN}, where, for k > 0, <rW as (t 1 , ...,i n ) 6 T m is the /c-th sequence of 
n € IN transitions to fire, at time kS, beginning from state jM- and reaching state 
sM n ~ sW, such that for i = (<r ! °l - NULL and jM° is obtained 

from sN-i] by advancing the time from (A: - l)«f to k8). □ 

Informally, conflicts and confusions can arise in the context of contemporary Airing attempts 
of PN transitions, which need to be sequentialized, and where different sequences of (formerly 
contemporary) transition firings lead to different undefined stochastic outcomes. A DDSPN is free 
of conflicts and confusions if it is well-defined, a precondition for its analysis. The general approach 
of well-defined SFNs has been first introduced in [8] and we now adapt it to give a formal definition 
of well-defined DDSPNs: 

Definition 4.4 A DDSPN is well-defined if its basic process is completely defined, that 
is, if 

V* € IN, V<r 6 r,Vs e S, Pr{*M = *,,« = 
is completely determined by the elements of the DDSPN. □ 

In practice, we are normally interested in stochastic reward processes derived from the basic, 
process. Without going into too much detail (see [7] for a discussion of the use of reward rate:- and 
impulses to define measures of interest), we give the following: 





Definition 4.5 A stochastic process {yW £ IR | fc £ JN + } is & reward process derived 
from the basic process through the reward structure (p, r) if it is defined as: 

Y lk] = £ + 

where the reward rates p : IN^ — ► IR describe the rate at which reward is accumulated 
in a particular marking and the reward impulses r : (T x t IR describe the impulse 

accumulated when a particular transition is fired in a particular marking. □ 

It is then possible for the reward process to be well-defined, even when the basic process is not. 
Hence we need a further: 

Definition 4.6 A DDSPN is well-defined with respect to a reward structure ( p.r ) if 

Pr{yW = y } 

is completely determined by the elements of the DDSPN, where {Y^ € fft | k € IN + } is 
the reward process defined by applying the reward structure (p, r ) to the basic .process 
of the DDSPN. □ 

Corollary 4.1 A well-defined DDSPN is well-defined with respect to any reward struc- 
ture. O 

The concept of well-defined SPNs and the corresponding test algorithm have been extensively 
discussed in [8] where more details and examples can be found. 

4.5 Reduced Reachability Graph Generation 

In this section we will propose an algorithm for the construction of the (finite) reduced reachability 
graph (RRG) and for the calculation of the impulse rewards of a well-defined DDSPN. The algorithm 
also tests whether the DDSPN is well-defined. The overhead for this test is small, because it is 
based on the state space of the RRG and on the impulse reward measures. Rate rewards are not 
affected by conflicts and confusions, since they are calculated before any transition firing occurs. 
Therefore, the calculation of rate rewards is omitted, for the sake of better readability, but it can 
be easily included into the algorithm. Formally, the algorithm is given: 

. a DDSPN (P, T,D“,D + , 9 , pI°l,<6W,4>,G,F,^ 0 J,v,C,w), and 


13 


« a set of impulse reward functions M — {r 1 , 

where r?{ji) € IR is the impulse reward obtained when firing transition t in marking p 
according to the m-th reward structure. 1 < m < }M |. 

If the DDSPN is well-defined, the algorithm computes the underlying tangible state space S 
and all state transitions Vs * U,€sP,i such that a single path set V, contains the zero-time state 
transitions starting from state $. Hence, given that a tangible state s is reachable from a state s, 
there is a tuple (73,77?) € P, containing the corresponding state transition probability 773 G ( 0 , 1 ] and 
a vector 73 = (7), ...,7 j M| ) G IR* W| , which stores the accumulated reward value 7^, for every impulse 
reward function r n G M. A single tuple (73, 773) € V, also represents the aggregated individual 
probabilities and accumulated impulse rewards of possible multiple paths along vanishing states 
leading from s to s. 

The nonzero entries of the one-step transition prob- Mlity matrix P for the underlying DTMC 
of a DDSPN are then given by: V.$,S G 5 , VP , G Vs,V{'n,r)i) G V, : P 4 ,» — rp. If the expected 
accumulated impulse rewards up to time kS, £[ 7 ^ | sW = s] are known, the expected accumulated 
impulses up to time (fc + 1)<5 are given by Vfc G IN, Vs, s G S, VP, G Vs ' 

ep-M I (,W = j A = 3 )J = I JH =,] + ('" 6 V •' 

[ 0 otherwise. 

Standard numerical methods (power method. SOR) can be employed for the transient or stationary 
solution of the processes of interest. 

If the DDSPN is not well-defined, the algorithm issues an error message and needs to be restarted 
after a conflict or confusion situation has been resolved by the means of priority or weight definitions. 
See [8] for a more detailed discussion of non -well-defined DDSPNs and their implications. 

Briefly, the algorithm consists of the procedure “generateRRG 11 in Fig. 8, where the time is 
advanced in a given tangible state = s leading to il* +1 l 0 « J°, and of the procedure “traverse* 
in Fig. 10, where subsequent vanishing states are recursively traversed starting from =: 3° 

until tangible states $! fc+I l = $ are reached. Three types of parameters exist: call by value (in), call 
by reference (out), and call by value-reference (inout). 

The algorithm is exercised with the call. “genera.teRRG( 5 , Vs)" . The set S"'** contains the 
tangible states which have not yet been visited. It is assumed that the initial state to be visited 
(^° 1 , 0 ^) is tangible. In case of a vanishing initial state v, only the initialization of the algorithm 
needs to be slightly adjusted by 

• first generating the set the initial tangible states reachable from v, and then 
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• by storing the state transition probabilities of reaching from i> as the initial sojourn 
probabilities in the underlying stochastic process (a DTMC) of the DDSPN. 

The initial probabilities are only relevant if a subsequent transient analysis of the DTMC is going 
to be i informed. For the stationary analysis of the (ergodic) DTMC, it is sufficient to calculate the 
first reachable tangible state as the initial state; no initial probabilities are then needed. 

procedure generateRRG( out: S , Vs ) 

S m 0; V s = 0; 

S next = 

while S next ^ 0 do 

choose a state s = (p, 4>) from $ next \ 

$ nezt _ $ncst \ 

for each <5° € Q{n,4>) do 

if C(3°) = 0 then # i° is tangible 
if 1° g S then 

S m S U {3°}; S nttt = S Mtt U {3°>; 

P? = I 7* « = o}; 

else # 3° IS VANISHING 

traverse(i°; S, S nezl ; Vp); 

?? ■ Utn«0«r,* {(7if * 0. V • 0)} i 
V t = umfy-{V„ V% 

V s = Vs u-P,; 

end procedure 

Figure 8: Generation of the reduced reachability graph. 

Fig. 9 outlines the execution of “generatcRRG" . The while-loop of the procedure visits all states 
of S nczt and calculates the set of paths V t , accumulated for every iteration in Vs, for each state 
s 6 S r,tt> . The for-loop advances the time for one step 5 by generating, with every iteration, the new 
state 3°. depending on its possible combination of next phases 4>° 6 with it? corresponding 

probability g. Moreover, for every 3°, it generates the set of paths V\ leading from a to tangible 
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states via 1 ° and unifies them afterwards in the path set "P, covering all existing state transitions 
originating in s. Hence, if 3 ° is tangible, it is added to the sets of tangible states S and S next , if not 
already there, and a single initial direct path to 3 ° with probability g is created with no impulse 
rewards, since no transition firing lead to 3°. 3° is vanishing, the call H traverse(3°; 5, S next \ P$)” 

computes the path set Vp from which P® is afterwards obtained by multiplying all impulse rewards 
and path probabilities of P 3 o with the probability g of reaching 3 ° from s. 



Figure 9: Execution of “generateRRG”. 


The function unify- (P„P' t ) unifies two different path sets V, and P'„ whose origin lies in the 
same state so that multiple paths reaching the same tangible state 3 are merged, guaranteeing 
that V( 7 r,» 7 s),( 7 i<, > 7 i<) £ P t , a = = ( 7^1 ??!')• Therefore, the intersection V? is first 

constructed where paths of both sets ( 7 ,-,^-) € V, and ( 7 ^) € P' going to the same 3 are 
aggregated by summing the corresponding accumulated impulse rewards and path probabilities: 

P? ~ U {(ti + 7|» r ?i + Vs)} 

Then, all paths of V, and V, going to different tangible states are unified together with the inter- 
section P,.n into the set Pf\ 

U {(*,*)} U 7? 

which is also the value returned by the function. 

Fig. 11 outlines the execution of “traverse”. The first for-loop of the procedure in Fig. 10 
partitions all candidate transitions of into sets of candidate transitions C r belonging to the 
same weight class C z . The second for- loop fires all transitions of a particular set C x , so that, with 
every iteration, a single candidate transition t 1 6 C z is fired in marking according to its firing 
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procedure traverse( in: S’” 1 s inout: S , $”***; out: 'Pji-i ) 

Pp-» = 0; 

foreach C z € C do 

4 = CCJ 1 - 1 ) n c s \ = C; 

foreach t* 6 4 do # fire single candidate 
F = F~ l - D7jt,QP~ l ) + D^AF' 1 ); 
f = u>f\c.(F~ l ). 

foreach 4>* € T{t\p~ x ,4>'~ x ) do # apply race policies 

F - (A’»^); 

if C(s*) =» 0 then # S’ is tangible 
if s’ £ i 5 then 

$ = S U {.?*} ; S’**" = <S ne *‘ U {$•}; 

= {( 73 , /’>) |Vm 6 5 

else # I* IS VANISHING 

traverse($ s 's S , Pa<); 

”Pj— > = U(*ri,,jj)€?,i {(7i,^*/ 1 ^' 1 ) I Vfft € {1* • • . ) |Af|}> 

7r»(7r+^(^- i ) % )m; 

P*-i * um/y“(^I,, 'Pji-j); 
if Pj.-i — 0 then P> 

else if Pj.-t ^ Vf,ii then stop? # error, DDSPN* not well-defined 
end procedure 

Figure 10: Traversing recursively vanishing states. 

probability /* leading to p\ For each firing transition V the third for-loop applies the corresponding 
race policies to all phases of and generates, with every iteration, the new state a* = {p i -4 >< ) 
with probability F ‘ depending on the possible combination of next phases & € F{t\ A 1-1 ,^’" 1 )- 
Analogously to the for-loop of “generateRRG” , it first generates the set of paths 'Pji-i leading from 
s’" 1 to tangible states via s’, for every s', and then it unifies them in the path set vf,i, covering 
all existing state transitions initiated by firing transitions of 4 in s’" 1 . Again, if s' is tangible 
(terminating recursive calls), it is added to the sets of tangible states S and S nett , if not already 
there. Moreover, a single initial direct path Pj,., with probability f'F' (Pr{/V}Pr {(£'}) for reaching 
the tangible is created together with instantaueous impulse rewards gained by the firing of t' in 
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£ ,_1 leading to 5'. If * f is vanishing, the subsequently reachable states ara explored by the recursive 
call “traverse^’; S, S ntxt \ V v )* which computes the path set Vy (assuming that the vanishing 
reachability graph created from s' is acyclic, finite, and that no conflict or confusion occurred). 
V'y-i is then obtained from Vy by adding the instantaneous impulse rewards of t' to Py. so that 
the probability of a particular path and of the accumulated impulse rewards equals to r?£ = f'F'rn 
for reaching a tangible state s from s’ -1 via s'. 



Conflicts and confusions exhibit a non-deterministic behavior which can occur in DDSPNs only 
in a vanishing state s' -1 when multiple candidate transitions t € C(l ,_1 ) attempt to fire in zero- 
time leading to tangible states 3 with different stochastic outcomes. Indeed, the DDSPN evolution 
during instants of time where there is no firing is completely determined by the assumption of a 
race behavior. 

It is possible to resolve conflicts and confusions by employing one of the following two methods. 
Priorities can be defined to prevent conflicting transitions from becoming simultaneous candidates, 
hence from attempting to fire at the same time. The second method groups candidate transi- 
tions involved in conflicts or confusions into the same weight class C,. so that contemporary firing 
attempts are resolved probabilistically by the individual firing probability /' for each candidate 
t' 6 & x where /' ~ 1. Then, candidate transitions belonging to different weight classes are 

free of conflicts and confusions, and they reach from all vanishing states 5 1 " 1 the same tangible 
states with the same probabilities and with, the same accumulated impulse rewards, regardless of 
the order in which they are fired (a necessary condition for the absence of conflicts and confusions), 
such that. VC, € C : Pf,Z> = Vy- 1 . 

If a vanishing state is encountered with at least two different paths sets where Pf, ii ^ Pf, ¥ ~i , 
the DDSPN is not well-defined with regard to the particular reward processes of interest. The 
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modeler must then apply one of the following actions to transitions of C z and r w before restarting 
the algorithm, to remove conflicts or confusions: 

• Specify pre-selection priorities disabling a conflicting transition before the advance of time. 

• Specify post-selection priorities, thus forcing a particular sequence for contemporary firing 
attempts. 

• Merge the corresponding weight-classes of conflicting transitions and define appropriate weights 
for them. 


5 State Space Reduction 

In Section 4.5, it has been shown how the one-step transition probability matrix P of the underlying 
(finite) DTMC of a DDSPN is computed. In case of an irreducible DTMC, the stationary solution is 
obtained by solving the following system of linear equations with standard techniques (Gauss-Seidel, 
SOR): r = ffP and jt,- = 1. 

Since P is usually a sparse matrix, sparse storage schemes should be employed. Measures of 
interest are then derived from the stationary probability distribution vector v. 

A considerable reduction of the state space can be achieved if it is possible to advance the phases 
of enabled transitions during the state space generation for more than just one time-step S until 
a probabilistic split or a phase equal to 2 ero (vanishing state) is reached. This is the case when 
tangible states are encountered where the DTPs of the enabled transitions have a unit-step w which 
is a multiple of the basic underlying time-step S, a condition often met by deterministic transitions. 
Hence, the algorithm for the RRG generation is slightly modified to test whether the next maximum 
x phase advancements of all enabled transitions of a tangible state of S next have probabilities equal 
to one. Consider a tangible state aM = (f|W,^M) at time kS from which the following sequence of 
states is initiated 

=Z (#+>1 = (^*1 ,,#♦«]) I ,• € (] ) 2,.,.,x},x> 1), 

so that: 

3x € 1N + ,Vj € -{1,2. : Pr = (^M ^l*+0)| a |*-M-ij B * j A C( d I*+*-U) « 0, 

Since no change of marking and no transition firing occurred, the states of s* were generated solely 
by phase advancements of enabled transitions whose phase transition probabilities equal to one, 
hence, 

V 3 f*+'l = (,|M,*IM) € a\Vf £ £(al* +, - , >) : C?,(/iW,4* + ‘" l, ,4 M ) * 1. 
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Therefore, it becomes possible to advance directly from to leaving out the intermediate 
tangible states {sl* + ‘1|i € {1,2, ...,x - 1}} while adding their individual holding times of h t i*+o = 5 
to the holding time of so that = xS. If the last state of the sequence is vanishing, si fc+ *l° 
is reached instead of s ik+z h 

The underlying stochastic process is then a discrete time semi-Markov process where P describes 
an embedded DTMC. The holding times in each state are no longer equal to 6 , but are given by the 
holding time vector h. The stationary solution can be obtained employing the follov 'ug well-known 
method for semi-Markov processes [ 9 J: We first solve the system of linear equations 7 = 7P and 
H;7t = 1 for the embedded stationary probabilities 7; then, we rescale 7 using the holding times, 
Vs € S : 7; = 7, • k t \ finally, we normalize the rescaled probabilities 7' and obtain the stationar y 
probability distribution: 7T = . 

In general the size of the state space depends on the size of the basic underlying time-step 6 
and on the number of phases of firing time distributions (DTPs) specified for the timed transitions 
of a DDSPN model. If embedding is used, the size of the state space depends, in addition, on the 
maximum possible phase advancements of all enabled transitions in tangible states. 

6 Example 

This section illustrates the. modeling power of DDSPNs by presenting an example containing several 
deterministically timed activities. Consider the processing station of an automated manufacturing 
system where raw parts arrive at constant time intervals. A machine tool processes each raw part 
for a constant time period. The tool wears off and needs to be replaced after a stochastically timed 
delay whose value depends on the tool quality and on the material of the processed parts. The 
time delay for the replacement is constant. The processing station can be then characterized by a 
D/D/l/K queueing system where the service station (tool) is subject to stochastic failures (wearout) 
and deterministically timed repairs (tool replacement). Fig. 12 shows the corresponding DDSPN 
model. Raw parts, represented by tokens, arrive with the firing of the deterministic transition 
arriving and wait for service on place WAIT until the service station is empty and operable. A 
single token on place IDLE SERVER and the immediate transition enter service permit only one part 
at a time to enter the service station which consists of the place SERVICE and of the deterministic 
transition serve. The. firing of serve stands for the completion of the processing of a single part. 
The failure and repair of the service station are represented by the geometric and deterministic 
transitions failure and repair, respectively. 

We consider a system with K — 50 parts, a constant deterministic arrival rate of -rlr and a 
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Figure 12: D/D/l/K queueing system with failure and repair. 

constant, deterministic repair rate of The deterministic service rate is varied from to ~ and 

the geometric failure rate is varied from ^ to jfa. The basic underlying time-step of the model 
equals to Is. 

The measure of interest of the stationary solution is the average number of waiting raw parts 
E{#W AIT} on place WAIT depending on the varying service and failure rates. The goal of our 
performance evaluation is to determine which minimum performance of the server, in terms of speed 
(service rate) and dependability (failure rate), suffices to achieve a desired average percentage of 
waiting raw parts. Fig. 13 shows the corresponding curves, where E{#W AIT} is plotted vs. the 
firing rates of transition serve and transition failure. 



a) 2D 


b) 3D 


Figure 13: Mean number of waiting raw parts (in rate and failure rate. 


The state space of the DDSPN consists of 101 tangible markings. Depending on the deterministic 
service rate 5,930 up to 125,153 tangible states have been generated. However, employing the 
embedding technique for the stationary solution of this particular model leads to a state space 
reduction of 86.4 
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7 Conclusion 


The results of [14], [5], and [$] have been combined introducing the DDSPN formalism where deter- 
ministic and stochastic firing times of transitions can be mixed without structural restrictions while 
providing integrated automatic conflict and confusion detection on a discrete time scale. 

A new solution method combining [5] and [8] and a previously not available algorithm for 
mapping a DDSPN onto its underlying stochastic process have been presented from which a direct 
implementation can follow. Thus, a new practical formalism in the field of performance evaluation 
has been enabled with new features based on discrete time as demonstrated for a typical queueing 
application example. 

Considerable state space reduction can be achieved for a given DDSPN model by carefully 
choosing timing parameters and, more importantly, by means of embedding. Even so, the DDSPN 
formalism still leads to a large state space due to the additional phase components in the state. 
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